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Abstract 

We give a definition of generalized indicators of sensitivity to ini- 
tial conditions and orbit complexity (a measure of the information that 
is necessary to describe the orbit of a given point). The well known 
Ruelle-Pesin and Brin-Katok theorems, combined with Brudno's theo- 
rem give a relation between initial data sensitivity and orbit complex- 
ity that is generalized in the present work. The generalized relation 
implies that the set of points where the sensitivity to initial condi- 
tions is more than exponential in all directions is a dimensional set. 
The generalized relation is then applied to the study of an important 
example of weakly chaotic dynamics: the Manneville map. 

1 Introduction 

When we think about a chaotic system there are two things that we 
expect to happen: 

• the behavior of the system is unpredictable and complex to be 
described 

• small differences on initial conditions leads to big differences in 
the evolution of the system. 



1 



A rigorous measure of initial conditions sensitivity is not difficult 
to formalize, it leads to the definition of Lyapunov exponents (see e.g. 
p6[| ) or to the more general Brin-Katok Q local entropy. 

A measure of the complexity of the behavior of a system is less 
simple to formalize and in the case of dynamical systems it was given 
by Brudno . A set of strings is associated by a certain construction 
to the orbit of a point and then the complexity of the orbit is defined 
by the Algorithmic Information Content (section 2 ) of the associated 
strings. The complexity of an orbit is then a measure of the amount 
of information that is necessary to describe the orbit. 

If dynamics are ergodic and lie on a compact space, it can be 
proved that the entropy of the system is almost everywhere equal to 
the orbit complexity. In other words, if such a system has positive 
entropy, then for the algorithmic information that is necessary 

to describe n steps of the orbit of x increases linearly with n and the 
proportionality factor is the entropy of the system. This also implies 
that if a system has an invariant measure fi, its entropy is equal to 
the mean value of the orbit complexity with respect to Q. 

It is known that if a system has positive entropy the typical speed 
of separation of nearby starting orbits is exponential (roughly speaking 
Ax{t) ~ Ax(0) 2'^*). The speed of separation of exponentially diver- 
gent orbits is characterized by the number A. Lyapunov exponents and 
Brin-Katok ^ local entropy are real valued indicators of the speed of 
exponential separation of the orbits (the number A on the exponent 
of the above formula). The work of Ruelle-Pesin and Brin-Katok 
shows (under some assumption on the dynamical system) that their 
indicators are almost everywhere equal to the entropy of the system. 
In other words: in an ergodic, compact dynamical system the indica- 
tor of (exponential) initial data sensitivity is a.e. equal to the entropy 
which is a.e. equal to the orbit complexity. Thus there is a relation 
between initial data sensitivity and orbit complexity. 

This implies that in the compact case orbit complexity and insta- 
bility are both faces of the same coin. In the case of compact dynamical 
systems this motivates the general Ford's claim |15] that orbit com- 
plexity was a synonym of chaos. We remark that if the space is not 
compact there are examples (|Q], |^^) of systems with no sensitivity 
to initial conditions and hight orbit complexity. 

In another definition of orbit complexity is given by the use of 
computable structures, the definition is given by a different approach 
involving some constructivity concept. This definition is equivalent 
to Brudno's one if the dynamics lie on a compact space. Replacing 
compactness with constructivity allows a more powerful investigation 
of the relation between orbit complexity and chaos in the non compact 
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case. 

In many examples of dynamical systems however the entropy could 
be 0, the speed of separation of nearby starting trajectories could be 
less than exponential and the increasing of the information contained 
in n step of the orbit could be less than linear. This is the case of the 
so called Weakly Chaotic Dynamics. 

The study of weakly chaotic dynamics was discovered to be im- 
portant for application purposes. There are connections with many 
physical and economic phenomena: self organized criticality, the so 
called chaos threshold, the sporadic dynamics, the anomalous diffu- 
sion processes and many others (see for example ||5|,[12],[32|,[19|,| 



In these examples of weakly chaotic dynamics the traditional indi- 
cators of chaos (K.S. entropy, Lyapunov exponents, Brudno's orbit 
complexity) vanishes. These indicators are not able to distinguish be- 
tween all the various cases of weakly chaotic dynamics. They see all 
them as trivial dynamical systems. 

Some definitions of generalized entropy have been already proposed 
in literature (see e.g. [30|,[24|,[32| for definitions about dynamical sys- 
tems). One of the most fruitful was the one given by Tsallis that 
found a great variety of applications: long range interacting systems, 
self gravitating systems, quantum mechanics, social phenomena and 
many others (see 

http:/ / tsallis. cat. cbpf.br/biblio. htin for an updated bibliography of re- 



lated topics). In the literature relations between Tsallis entropy and 
initial data sensitivity have been proved (|32|,pl|]), indicating that 
the main field of application of Tsallis entropy in dynamical systems 
is the case of power law initial data sensitivity (if two points starts at 
distance Ax(0) then Ax{t) ~ Ax{0)t"). 

The aim of this work is to give a very general definition of indi- 
cators of initial data sensitivity and orbit complexity and to prove a 
relation between them that generalizes the above stated "orbit com- 
plexity=sensitivity to initial conditions". This will have some inter- 
esting corollary as a consequence (Theorem ^) and finally we will see 
some applications of our formulas to some example of weakly chaotic 
dynamics. 

The indicators we will define will have values in a totally ordered 
set TZ which is constructed in section 3 by the use of the non standard 
analysis. In section 2 we add an elementary introduction to non stan- 
dard analysis, so that the paper is self contained. The ordered space 
TZ will contain (in some way) a representative of all the asymptotic 
behaviors for n ^ oo of sequences of reals a„ : N ^ R (for example 
the various orders of infinity and infinitesimal will correspond to some 
element of 7^) . In this way we include in one definition all the possible 
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asymptotic behaviors of initial data sensitivity, orbit complexity or 
entropy, and so on. 

We clarify this by an example. Let us consider the classical defi- 
nition of topological entropy for a compact dynamical system (X, T) . 
We recall and comment the original definition. If x,y £ X let us 
say that x,y are (n,e) separated if d{T^{x),T^{y)) > e for some 
k G {0,...,n - 1}. If d{T^{x),T^{y)) < e for each k G {0,...,n - 1} 
then X, y are said to be (n, e) near. That is: two points are separated 
if they give rise to substantially different orbits. A set E C X is called 
(n, e) separated if Vx, y £ E,x ^ y then x, y are (n, e) separated. Let 
us consider 

s(n, e) = max{card{E) : E C X is {n, e) — separated} 

The number s(n,e) measures the number of substantially different n 
steps orbits that appear in {X,T). 

A chaotic D.S. will have more and more possible different orbits 
as n increases. The idea of the definition is that in the more chaotic 
D.S. (where the entropy will be higher) the cardinality s{n, e) increases 
more quickly as n increases. 

The remaining part of the definition is a way to output a real 
number from this idea. The number will be a measure of the speed 
of exponential increasing of the cardinality s{n,e) as n increases. We 
define 

h{T, e) =limsup — - — ^ ' ^ 

n— >oo n 

and then the topological entropy of T is defined as 

htop{T) =lim hK{T,(). 

The logarithm in the definition is taken because s(n, e) is expected 
to increase exponentially (s(n, e) ~ 2'^'-"^''^)"). This is a very impor- 
tant case; the case of strongly chaotic dynamic. However, it is worth 
remarking that there are examples of chaotic topological dynamical 
systems with entropy (see ||2^ for example). 

When s(n, e) increases less than exponentially the value of /i(T, e) 
will be zero. If we want to state a definition of generalized topological 
entropy that is sensitive to the cases when s(n, e) increases as a power 
law we could define ("a la Tsallis" to some extent) 

hq{T,e) =limsup ^'^^^^ ^^^^ 



n 



where Sq : R ^ R is 



- 1 
1 - q 
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In this definition the parameter q plays a role similar to the Haus- 
dorff dimension. Each dynamical system will have a special value of q 
such that Sq{s{n, e)) increases linearly and allows a nontrivial value of 
hq. The special q of each D.S. will be an indicator of the type of chaotic 
behavior of the system under consideration. This definition will classify 
the various cases of power law increasing of s{n,e) and the exponen- 
tial one (when q = 1) but it makes no difference between exponential 
and stretched exponential^ (both q = 1) and between constant and 
logarithm {q = 0). 

We shall see later with the help of examples that the asymptotic 
behavior of the measures under study exhibit a large variety of differ- 
ent cases. So we need the more possible general definition. This will 
be done with a definition with values in TZ. Moreover in this general 
setting we can prove very general theorems that will have nontrivial 
meaning in all this variety of examples. We want to remark that the 
use of the language of the non standard analysis comes about natu- 
rally when we want to consider the asymptotic behavior of a sequence 
of reals. On the other hand, Benci gives an elementary but rigor- 
ous approach to the nonstandard analysis which we summarize in a 
page in section 2.3. This approach is very simple and does not require 
any deep tool of logic. So we think that our definitions can be easily 
understood by readers with no experience in this subject. 

In section 3 we define the notions of generalized initial data sen- 
sitivity at a point x and the notion of generalized complexity of the 
orbit of X. For the definition of constructivity and orbit complexity we 
introduce the notion of computable structure on a metric space (Sec- 
tion 2.2). Then, under the assumption that the system is construc- 



tive we prove a relation (Theorem 4C) between sensitivity and orbit 



complexity that is a quantitative and rigorous version of the follow- 
ing statement: the asymptotic behavior of the quantity of information 
that is necessary to reconstruct the orbit of x depends on the initial 
data sensitivity at x and on the 'complexity' of the point x in X. We 



remark that theorem 40 is general, it holds even in infinite dimensional 
spaces, provided that the maps we consider are constructive. 

This relation will have as a consequence that the points with upper 
initial data sensitivity {R{x) in Section 3.1) strictly greater than the 
exponential one are a dimensional set (Theorem |4^). 

We remark that our relations are pointwise. We make no use of 
invariant measures that in many cases of weakly chaotic dynamics 
are trivial or very complicated (with multifractal support). Instead 
sometime we make use of the natural measure that can be defined on 
the metric space X: the Hausdorff measure. 

1 s(n,e) ~ 2™°. 
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In section 4 we apply the the main results of section 3 to give a 
rigorous estimation of the orbit complexity in an important example 
of weakly chaotic dynamic: the Manneville maps. 



2 AIC, computable structures and non 
standard analysis 

2.1 Algorithmic Information Theory 

In this section we give an introduction to algorithmic information 
theory. The introduction will be informal, to help the reader that is 
not familiar with recursion theory to understand the paper. A more 
detailed exposition of algorithmic information theory can be found in 
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Let us consider the set S = {0, 1}* of finite (possibly empty) binary 
strings. If s is a string we define \s\ as the length of s. 

Let us consider a Turing machine (a computer) C: by writing 
C{p) = s we mean that C starting with input p (the program) stops 
with output s (C defines a partial recursive function C : S — > S). If 
the input gives a never ending computation the output (the value of 
the recursive function) is not defined. If C : S — > S is recursive and its 
value is defined for all the input strings in S (the computation stops 
for each input) then we say that C is a total recursive function from 
S to S. The algorithmic information content of a string will be the 
length of the shortest program that outputs the string. 

Definition 1 The Kolmogorov complexity or algorithmic information 
content of a string s given C is the length of the smallest program p 
giving s as the output: 

Kcis) = min \p\ 

C{p)=s 

if s is not a possible output for the computer C then Kc{s) = oo . 

For example by this definition we see that the algorithmic information 
content (A.I.C.) of a 2n bits long periodic string 

s =" 1010101010101010101010..." 

is small because the string is output of a shortest program: 

repeat n times (write ("10")) 
the AIC of the string s is then less or equal than log{n) + Constant 
where log{n) bits are sufficient to code "n" and the constant represents 
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the length of the code for the computer C representing the instructions 
"repeat...". As it is intuitive the information content of a periodic 
string is very poor. On the other hand each n bits long string 

s' =" 1010110101010010110..." 

is output of the trivial program 

turiteflOlOllOlOlOlOOlOllO...") 

this is of length n + constant this implies that the AIC of each string 
is (modulo a constant which depends on the chosen computer C) less 
or equal than its length. 

Until this point the algorithmic information content of a string 
depends on the choice of the computer C. We will see that there is 
a class of computers that allows an "almost" universal definition of 
algorithmic information content of a string: if we consider computers 
from this class the A.I.C. of a string will be defined independently 
of the computer up to a constant. In order to define such a class of 
universal computers we give some notations that are necessary to work 
with strings: there is a correspondence c : E — > N from the set S and 
the set N of natural numbers 

0^0, 0^1, 1^2, 00^3, 01^4, 10^5,... 

This correspondence allows us to interpret natural numbers as 
strings and vice- versa when it is needed. We remark that |,s| < log{c{s))+ 
1.0 

If s is a string with |s| = n we denote by s " the string soSoSiSi...Sn-iSn-i01. 
If a = ai...o„ and b = bi...bm are strings then ab is defined as the 
string ai...anbi...bm- If a and b are strings then a"6 is an encoding of 
the couple (a, b). There is an algorithm that getting the string a ' 6 is 
able to recover both the strings a and b. An universal Turing machine 
intuitively is a machine that can emulate any other Turing machine 
if an appropriate input is given. We recall that there is a recursive 
enumeration Ai,A2.-- of all the Turing machines. 

Definition 2 A Turing machine U is said to be universal if for all 
m € N and p G S then lJ{c^^{m) "p) = Am{p)- 

In the last definition the machine lA is universal because lA is able 
to emulate each other machine Am when in its input we specify the 
number m identificating A^ and the program to be runned by Am- It 
can be proved that an universal Turing machine exists. 

^ In this paper all the logarithms are in base two. 
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Definition 3 A Turing machine F is said to he asymptotically opti- 
mal if for each Turing machine C and each binary string s we have 
Kf{s) < Kc{s) + c where the constant c depends on C and not on s. 

The following proposition can be proved from the definitions 

Proposition 4 IfU is an universal Turing machine thenU is asimp- 
totically optimal. 

This tells us that choosing an universal Turing machine the com- 
plexity of a string is defined independently of the given Turing machine 
up to a constant. For the remaining part of the paper we will suppose 
that an universal Turing machine lA (p) is chosen once forever. 

2.2 Computable Structures, Constructivity 

A computable structure on a separable metric space {X, d) is a class 
of dense immersions (J : S — *• X) of the space of finite strings S in the 
metric space. The immersions are such that the distance d restricted 
to the points that are images of strings (x = I{s) : x £ X, s Ti) is 
a "computable" function. Many concrete metric spaces used in anal- 
ysis or in geometry have a natural choice of a computable structure. 
The use of computable structures allows to consider algorithms acting 
over metric spaces and to define constructive functions between metric 
spaces, that is, functions such that we can work with by using a finite 
amount of information. In the following we often will assume that the 
dynamical systems under our consideration are constructive. All the 
dynamical system that we can construct explicitcly arc construcivc. 
From the philosophical point of wiew we think that the assumption of 
constructivity is not unnatural because even if the maps coming from 
physical reality were not constructive, the models used to describe 
such a reality should be constructive (to allow calculations). On the 
other hand, to add constructivity allows to prove stronger theorems, 
avoiding pathologies coming from random maps. 

An interpretation function is a way to interpret a string as a point 
of the metric space. 

Definition 5 An interpretation function on {X, d) is a function I : 
S — ^ X such that /(S) is dense in X. 

A point X £ X is said to be ideal if it is the image of some string 
X = I{s),s G S. An interpretation is said to be computable if the 
distance between ideal points is computable with arbitrary precision: 
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Definition 6 A computable interpretation function on {X, d) is a 
function I : T, ^ X such that /(S) is dense in X and there exists a to- 
tal recursive function D:$]xSxN^Q such that Vsi, ,82 G T,,n S N; 

\d{I{si),I{s2))-D{si,S2,n)\<^. 

Two interpretations are said to be equivalent if the distance from 
an ideal point from the first and a point from the second is computable 
up to arbitrary precision. For example, the finite binary strings s G T, 
can be interpreted as rational numbers by interpreting the string as 
the binary expansion of a number. Another interpretation can be given 
by interpreting a string as an encoding of a couple of integers whose 
ratio gives the rational number. If the last encoding is recursive, the 
two interpretation are equivalent. 

Definition 7 Let Ii and I2 be two computable interpretations in {X,d); 
we say that Ii and I2 are equivalent if there exists a total recursive 
function D* : S x S x N — > Q, such that Vsi, S2 £ S, nG N; 

\d{h{si),l2{s2)) - D*{si,S2,n)\ < ^. 

Proposition 8 The relation defined by definition is an equivalence 
relation. 

For the proof of this proposition see [0]. 

Definition 9 A computable structure I on X is an equivalence class 
of computable interpretations in X . 

For example if X = R we can consider the interpretation / : S ^ 
R defined in the following way: if s = € S then 

I{s)= J2 ^.2[-/2l-. (1) 

l<i<n 

This is an interpretation of a string as a binary expansion of a number. 
I is a computable interpretation, the computable structure on R con- 
taining I will be called standard computable structure. If r = rir2... is 
an infinite string such that lim ^'^^'^^'"^"^ = 10 then the interpretation 
Ir defined as Ir{s) = I(s) + X] '^(^2"* is computable but not equivalent 
to /. / and Ir belongs to different computable structures. 

■^such a string exist, see for example Q theorem 13. 
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In a similar way it is easy to construct computable structures in 
Yin separable function spaces codifying a dense subset (for ex- 

ample the set of step functions) with finite strings. We remark as a 
property of the computable structures that if Br{I{s)) is an open ball 
with center in an ideal point I(s) and rational radius r and I{t) is an- 
other point then there is an algorithm that verifies if I{t) £ Br{I{s)). 
If /(t) e Br{I{s)) then the algorithm outputs "yes", if /(t) ^ -B,.(I(s)) 
the algorithm outputs "no" or does not stop. The algorithm calcu- 
lates D{s,t,n) for each n until it finds that D{s,t,n) + 2~" < r or 
D{s, t, n) — 2~" > r, in the first case it outputs "yes" and in the second 
it outputs "no", if d{I{s), I{t)) ^ r the algorithm will stop and output 
an answer. 

We give a definition of morphism of metric spaces with computable 
structures, a morphism is heuristically a computable function between 
computable metric spaces. 

Definition 10 If {X,d,Z) and {Y,d',J') are spaces with computable 
structures; a function ^ : X ^ Y is said to be a morphism of com- 
putable structures if ^ is uniformly continuous and for each pair I E 
1,J & J there exists a total recursive function D* : S x S x N ^ Q, 
such that Vsi, S2 G S, nG N; 

\d'{^{I{si)),J{s2)) - D*{si,S2,n)\ < ^. 

We remark that ^ is not required to have dense image and then 
^'(/(*)) is not necessarily an interpretation function equivalent to J. 

Remark 11 As an example of the properties of the morphisms, we 
remark that if a map ^ : X ^ Y is a morphism then given a point 
X E -^(S) d X it is possible to find by an algorithm a point y G C 
Y as near as we want to ^'(x). 

The procedure is simple: if a; = I{s) and we want to find a point y = 
J{zo) such that d' {I (s)) , y) < 2"™ then we calculate D*{s,z,m + 2) 
for each 2; G S until we find zq such that D*[s, ZQ,m + 2) < 2^™^^. 
Clearly y = J{zq) is such that d'{'^{x), y) < 2~™. The existence of such 
a Zq is assured by the density of J in y. In particular the identity is a 
morphism. Remark lll| applied to the identity will be used in the proof 



of lemma 13 



A constructive map is a morphism for which the continuity relation 
between e and 6 is given by a recursive function. The following is in 
some sense a generalization of the definition of Grzegorczyk, Lacombe 
(see e.g. p^) of constructive function. 
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Definition 12 A function ^ : (X,d,I) — > {Y,d',J) between spaces 

with computable structure {X,Z), {YjJ') is said to be constructive if^ 

is a morphism between the computable structures and it is effectively 

uniformly continuous, i.e. there is a total recursive function / : N ^ 

N such that for allx,y € X d{x,y) < 2~-/'(") implies ^(y)) < 

2-n_ 

If /(n) is recursive and satisfies the hypotliesis that, d{x, y) < 
2"/{") implies d{T{x),T{y)) < 2~" then max{f{n),n) is recursive 
and still satisfies the hypothesis. Then we can suppose that if f{n) is 
a function of effective continuity then f{n) > n. 

If a map between spaces with a computable structure is construc- 
tive then there is an algorithm to follow the orbit each ideal point 
X = /(so). 

Lemma 13 If T : {X,Z) {X,Z) is constructive, I GZ then there 
is an algorithm (a total recursive function) ^:SxNxN— >S such 
that yk,me N,so G S d{T''{I{so)), I{A{so,k,m))) < 2~". 

Proof. Since T is effectively uniformly continuous we define the 
function gk{m) inductively as gi{m) = + gi{m) = f{gi^i{m) + 
1) where / is the function of effective uniform continuity of T (def- 
inition H). If d{x,y) < 2-9'--('") then d{T'{y),T'{x)) < 2"™ for i G 
{1, ...,k}. Let us choose I £ Z. We recall that the assumption that T 
is a morphism implies that there is a recursive function D*{si,S2,n) 
such that 

\D*{si, S2,n) - d{I{si),T{I{s2)))\ < 2-". 

Let us suppose that x = I{so). Now let us describe the algorithm 
A: using the function D* and the function /, A calculates gk{m) 
and finds a string si such that d(I(si), r(/(so))) < 2"^'=(™) as de- 
scribed in remark This is the first step of the algorithm. Now 
d{T{I{si)),T'^{x)) < 2-^9k-i+i)_ pg^j^ jj* ^ gi-^ij^g g^pj^ 

that (i(/(s2),r(/(si))) < 2-(f*-i+i). By this d{I{s2),T'^{x)) <2-'9^-^. 
This implies that <i(T(/(s2)),T3(x)) < 2-(9fe-2+i), then we find S3 
that (i(/(s3), T(s2)) < 2~(^'=-2+^) and so on for k steps. At the end we 
find a string Sfc such that d{I{sk),T''{x)) < 2'"^ . □ 

2.3 Non standard analysis 

We define the extended real line R* to be an ordered field satisfying 
suitable axioms. The existence of such a field is proved in Q. R* will 
contain the standard real numbers and other elements representing 
infinite and the infinitesimal numbers. 

We call Hyperreal Line a field satisfying the following axioms: 
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Axiom 14 The set of the hyperreal numbers R* is an ordered field 
which contains R as a subfield. 

Axiom 15 There is a surjective ring homomorphism 

J : RN ^ R* 

associating to each real sequence an hyperreal number. 

Intuitively the homomorpiiism J associates to a sequence of reals 
its asymptotic behavior. For example if Urn a„ = then J (an) will 

n— ►oo 

be an infinitesimal number. Moreover if a = (oj) and b = (hi) are two 
sequences we would like that if > hi for all i G N then J (a) > J{b). 
For this reason J is required to satisfy the following monotonicity 
property 

Axiom 16 If there exists k G such that 

Vn G N+,0fc„ > a 

with a € R, then 

J{(t)) > a . 

From axiom |l6| it follows for example that if aj = 2~* and bi = j then 
< J(aj) < J (pi). Another consequence of axiom |l^ is that for each 
real sequence Xi liminf{xi) < J{xi) < limsup{xi). 

A field satisfying our axioms exists. As the reader could imagine, 
it can be constructed from the set of real sequences modulo a suitable 
equivalence relation (|0]). 

2.3.1 Extension of functions, infinite and infinitesimal 
numbers. 

Given any function / : R ^ R we extend it to a function /* : R* 
R* as follows: if is a real sequence and x = J{ai) £ R* we define 

f*{x) = f*{J{a,)) = J{f{ai)). 

Proposition 17 the definition is well posed i.e. J{ai) = J{bi) implies 
that J{f{ai)) = J{f{h)). 

The proof of proposition |l^ can be found in 0]. 

As we stated before, in R* there are some elements representing 
the infinite and infinitesimal numbers: 
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Definition 18 An hyperreal number ^ is called infinite i/ VA; G N we 
have \(^\ > k. A number ^ is called infinitesimal if\/k G N, |^| < A 
number ^ is called bounded if 3A; G N, |^| < k. 

For example the reader could verify directly from the axioms that if 
aj : N — > R is the identity: Ui = i then J(aj) is infinite and J{-^) is 
infinitesimal. 

3 sensitivity and orbit complexity 

Now we construct the space TZ in which our indicators of orbit com- 
plexity and initial data sensitivity will have value. 

Definition 19 If a,b G R* we say that a and b have the same order 
and write a ^ b if and only if both | and ^ are bounded. 

~ it is clearly an equivalence relation. In the following by [a] we will 
indicate the equivalence class of a. 

We now define an ordering relation on the quotient space We 
say that [a] < [6]0 if Vx G [a], Vy G [b] then or x ~ y or x < y. We 
remark that the order relation on R* is compatible with the equiva- 
lence relation ~, if a < 6 in R* then [a] < [b] in ^ . And thus ^ is 
totally ordered. The relation < is then defined in the obviuos way as 
[a]<[b] ^ [a]<[b],[a]^[b]. 

^ contains a representative of all the infinite (infinitesimal) asymp- 
totic behaviors of real sequences. ^ is sometime called the group of 
orders. The natural projection from R* to ^ : a — > [a] allows to for- 
get all the lower order terms in the hyperreal number a: for example if 
Oj = i as above J(ai^ + ai) and J{ai^ + ^/ai) belongs to the same class 
as J{ai'^), in other words [J(aj^ + aj)] = [J(aj^ + ^/ai)] = [J(ai^)]. 

Unfortunately ^ is not complete (as R* is not complete). The 
supremum or the infimum of a sequence in ^ may not exist in 
For this reason we will consider a space TZ which is a completion of 
the sup and in/ of each sequence in ^ is in TZ. We now outline a 
possible construction of a completition of there are other possible 
costructions. Another possible completition of ^ can be constructed 
for example by Dedekind sections. We construct TZ by quotienting the 
set of monotone sequences in ^ by a suitable equivalence relation. 
This will add the supremum to each countable sequence. 

"^By an abuse of notations we use the symbol < for this ordering relation, this will cause 
no ambiguity with the ordering relation defined on R* . 
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Proposition 20 There is an ordered space TZ such that <Z TZ in 
a natural and order preserving way and if ai & is a monotone 
sequence then inf[ai) and sup{ai) are in TZ. 

Proof. Let us consider the set of monotone sequences in ^^^^j^: 
A = {(oj) : N s.t. ai is monotone} 

in A the set ^ will be identified with the subset of constant sequences. 

We define the ordering relation on A in the following way (oj) < 
(bj) <^=^ 3M such that Vn, m with n > M, m > M then an < bm ■ 

We define the relation ~ in the following way: (oj) ~ (bj) if neither 
(aj) < (bj) nor (bj) < (ai). ~ is an equivalence relation: « is trivially 
symmetric and reflexive. The transitivity follows from the remark that 
if Oj is not < bj then VM 3n, m s.t. n > M, m > M, an > b^. As it is 
easy to verify this is a transitive relation (because the sequences in A 
are monotone). 

The set of equivalence classes 7^ = ^ is then totally ordered in 
the same way as before and contains ^ as a subset. Moreover each 
monotone sequence in has its sup and inf in TZ: let us indicate 
with p the natural projection associating to each element in A its 
equivalence class. If for example a = (oj) is a nondecreasing sequence 
then inf (a) is the equivalence class of the constant sequence b = (bj) 
such that \/j bj = oq and sup{a) = p{a) (p is the natural projection 
map as deflned above). It is easy to verify that p{a) > aj for each 
j G N and for each x £ TZ s.t. Vj G N,x > Oj we have x > p{a) or 
X PS p{a) .□ 

The set TZ may look in some way mysterious and not practical to 
be used. The reader will see in the examples that the elements of TZ we 
will have as value of our invariants will be classes that can be expressed 



in an explicit way. For example a possible value of r{x) (definition 24) 
could be [J{n~2)] (the class in containing the asymptotic behavior 
of the sequence a„ = n~^). Since is immersed in 7^ in a natural 
way we can consider an element of as an element of TZ without 
ambiguity. Another possible value of r(x) could be [^(^"s)] and it is 
clear that [J(n~2)] < [J(n~3)] so we can easily compare the values. 

The notion of infinite and infinitesimal numbers can be extended to 
the elements of 7?.: if f G R, v > then c = [J(f )] is the element of TZ 
corresponding to the class of bounded and not infinitesimal numbers. 
Moreover: an element e £ TZ is said to be infinitesimal if e < c and an 
element 7 G 7?- is said to be infinite if e > c. 

Finally we remark that TZ is closed by countable inf and sup and 
the projection p (defined in the proof of the above proposition) can 
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be extended to a function from the set of monotone sequences in TZ to 
TZ, associating to a sequence its supremum or infimum according that 
the sequence is increasing or decreasing. 

Proposition 21 If (ui) is a monotone sequence in IZ, then 

sup{ai),inf{ai) e TZ 



Proof. Let us suppose that (aj) is a non decreasing sequence, the case 
where (at) is non increasing is analogous. We show that sup{ai) € TZ. 
If {oi) is eventually constant the proposition is obvious. If (oj) is not 
eventually constant let us consider a subsequence that is strictly 
increasing (V/c Oj^, > The elements ai^,ai^,_-^ G TZ are equiva- 

lence classes of monotone sequences with values in . Let use consider 
two of this sequences (a^^^)„gN : N ^ 4r such that p((a^~^)„gN) = 
(ai^_J and (a^)„gN : N ^ ^ such that p((a^)„eN) = (aj^.J. Since 
(q!^~^) < (a^) then 3Mk G N s.t. Vn a^~^ < a\^^. This is true for 
each choice of the sequences a^,a^~^ in the classes Ofc,afc_i, hence 
what follows does not depends on the choice of and a^~^ . Let us 
now consider the sequence (a^^)fceN : N ^ this is an increasing 
sequence and Vj < fc, < of^^, then \/i G N,p(a^^^) > Oj. Now it 
is easy to see that if b is such that Vi^fe > Oj^. then h ~ p(a|^^) or 
b > p{a\^J, then p(a;|^J is sup{ai). □ 

By the above result we also see that the function p : A ^TZ can be 
extended to a function p : {(aj) : N — > 7^ s.t. Oj is monotone} -^TZhy 
associating to each sequence its sup of inf according that the sequence 
is increasing or decreasing. 

3.1 Initial data sensitivity 

Let X be a separable metric space and T a function X — > X. ^ Let us 
consider the following set: 

B{n, X, e) = {y G X : d{T\y),T{x)) < e Mi s.t. < « < n}. 

B{n, X, e) is the set of points "following" the orbit of x for n steps 
at a distance less than e. When the orbits of (X, T) diverges the set 
B{n,x,e) will be smaller and smaller as n increases. The speed of 

^We remark that in this and in the following subsection we do not require that T is 
continuous. 
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decreasing of the size of this set considered as a function of n wih 
be a measure of the sensitivity of the system to changes on initial 
conditions. 

Brin and Katok used the set B{n,x, e) for their definition of local 
entropy Q. In their paper the measure of the size of B{n, x, e) was the 
invariant measure of the set. 

If we are interested to approximate the orbit of x for n steps we are 
interested to know how close we must approach the initial condition x 
to ensure that the resulting approximate orbit is close to the orbit of 
x; another possible measure of the size of B{n, x, e) is then the radius 
of the biggest ball with center x contained in B{n, x, e). 



r(x, n, e) = sup r 

Br(x)cB{n,x,e) 

Or the radius of the smaller ball that contains B(n, x, e) 



R{x, n, e) = inf R 

Bji{x)DB{n,x,e) 

As said before the generalized initial data sensitivity will be a 
function associating to a point of X a class in TZ indicating how faster 
orbits coming from a neighborhood of x will diverge. For this purpose 
we measure how faster r(x,n,e) decreases as n increases, i.e. we con- 
sider the asymptotic behavior of the sequence r{x, n, e) as n increases. 
First we define 



Definition 22 We define : X —>■ as 



r^{x) = [J{r{x,n,e))] 



and 



R,:X^^as 



R,ix) = [J{R{x,n,e))] 



The following lemma implies that r^{x) and Re{x) are monotone 
functions with respect to e. 

Lemma 23 If e > 6 then r^{x) > rg{x), Re{x) > Re{x). 
Proof. Obvious □ 

For the previous lemma we define the indicator of initial data 
sensitivity at x by letting e go to as the infimum of the r^(x) for 
e E R, e > 0. This infimum will be in TZ. 
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Definition 24 We define the indicator of initial data sensitivity at x 
as 

r{x) -x^n 

r{x) — inf r\{x) 
eeR+ 

In the same way we define 
R{x) :X^n 

R{x) = inf R^{x). 

eeR+ 

The classical definition of dynamical system sensitive to initial con- 
ditions is related to our last definition. To say that a system is sensitive 
to initial conditions is equivalent to say that there is a 5 such that (x) 
is infinitesimal for all the x £ X: 

Definition 25 A dynamical system {X,T) is said to have sensitive 
dependence on initial conditions if there is a 5 such that for each x £ X 
and every neighborhood U of x there is y & U and fc G N such that 
d{T\x),T\y))>5. 

Proposition 26 A system has sensitive dependence on initial condi- 
tions if and only if there is a 5 such that Vx G X rs{x) is infinitesimal. 

The proof follows directly from the definition of rs{x). 

We give some example of different behaviors of r{x) and R{x) in 
dynamical system over the interval [0, 1]. The identity map T{x) = x. 
In this map Vn B{n, x, e) = {y £ [0, 1], s.t.\y — x\ < e} then if we choose 
for example a; = ^ we have n, e) = r(^,n, e) = e i.e. the constant 
sequence with value e. Then -Re(|) = ?'e(|) = where J(e) is the 

number in R* corresponding to the constant sequence with value e 
and R{^) = r{^) = [J(e)] = {x e R* s.t. x is bounded} i.e. the class 
containing the numbers in R* corresponding to the constant sequences. 
The same arguments can be applied to the irrational translation on 
[0, 1]: T(x) = X + t {mod 1) where t ^ Q obtaining the same kind of 
initial data sensitivity as the identity (in effect both the maps are not 
sensitive to initial conditions). 

The one dimensional baker's map T : [0, 1] [0, 1], T(x) = 2x {mod 1). 
If we choose for example x = , we have B{n, 0, e) = {y G [0, 1], < 
y < 2-"e}, i?e(0) = re(0) = [J(e2-")] and R{0) = r(0) = [J(2-")] 
i.e. the class containing all the bounded multiples of the exponential 
infinitesimal number. 
The piecewise linear map T : [0, 1] [0, 1] 
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T{x) 



jE^ a<x<l 



with 



^T— , /c G iV, z G R, z >2. This is a P.L. version of the Man- 

neville map T(x) = x -\- [mod 1) (see fig 1), this example will be 
discussed more deeply in Section 4. In this example any neighbor- 
hood of the origin = [0, e) is subdivided in a sequence of intervals 
= (^jfc;Cfc-i] and if A; > 1 then T{Ak) = Ak-i- Let us choose x = 0, 



that is a class of infinitesimals corresponding to power law decreas- 
ing sequences whit exponent In other words the map T{x) has 
power law sensitivity to initial condition at the origin. In Section 4 we 
will see that while the sensitivity to initial condition at the origin is 
a power law, for almost all other points in [0, 1] we have a stretched 
exponential sensitivity. This example is important in the applications 
and will be studied more deeply in section 4. 

3.2 orbit complexity 

Now we define our indicator of orbit complexity. In the philosophy of 
the algorithmic information content we define the complexity of the 
orbit of X as the asymptotic behavior of the quantity of information 
that is necessary to reconstruct the orbit, i.e. the asymptotic behavior 
(with respect to the variable n) of the length of the smallest program 
that can approximate n steps of the orbit with its output (at accuracy 
e). As before we consider the behavior when n goes to oo and the 
accuracy parameter goes to . 

To interpret the output of a calculation which is a finite string as 
a finite sequence in X let us consider an interpretation function I and 
a total recursive surjective function. 



where S* is the set of finite sequences in S. Now let us consider an 
universal Turing machine U, for each program p we define U{p) G X* 
(the set of finite sequences in X) as 



where I is extended obviously to a map from the space S* to X*. 
Ui{p) G X is defined as the i—ih point of U{p) . With this definition we 

can interpret the output of a calculation as a finite sequence in X. We 
remark that given Q and a sequence of strings si, it is possible 
by an algorithm to find a single string s such that Q{s) = (si, Sn)- 



then S(n,0,Cfc) = [0,Cfc+„). By this we find r(0) = [J 




Q : S ^ S* 



U{p)=I{Q{U{p))) 
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Definition 27 We define the algorithmic information content of the 
sequence x,T{x), ...,T'^(x) G X* at accuracy e and with respect to the 
interpretation I as: 



£\x,n,e) = mm\\p\ s.t. U{p) £ max {d{Ui{p),T\x))) < e\ . 

L 0<i<n J 

As before we consider the behavior for n — > oo and define £^{x,e) : 
X xK^^ as: 

£'ix,e) = [J{£'{x,n,e))]. 



Remark 28 £^{x,e) is a non increasing function with respect e. 

Finally, like in the definitions of initial data sensitivity we consider 
the behavior when e goes to and we define £\x):X^n as 

Definition 29 The orbit complexity of x with respect to the interpre- 
tation I is defined as: 

£\x) = sup £\x,e). 

eGR+ 

We now give some example of different behaviors of £^{x). If x 
is a periodic point it is easy to see that £\x) < [J {log{n))]. By the 



results of |1C] and |17| it follows (see also Section 1) that if a system is 
compact, ergodic and has positive Kolmogorov entropy then for almost 
all points we have £^{x) = We also remark that (when the 

space is compact) this is the maximum over all the possible behaviors. 
Indeed if X is compact, for each e there is a finite cover made of balls 
with ideal center and radius e, then a program that follows n steps 
of the orbit of any point with the accuracy e can be simply made by 
listing n centers of the cover, then, if X is compact £\x) < [J(n)]. 
In section 4 we will study the complexity of the orbits of another, less 
trivial example. 



Lemma 30 // /, J are computable interpretation functions from the 
same computable structure: I, J £ I then £\x) = £'^{x). So the orbit 
complexity does not depend on the choice of the interpretation I in 
the computable structure I and we can define £^{x) = £^{x) for some 

I el. 



Proof. Let us consider equivalent interpretations Ii , I2 and 
U = Ii{Q(l{{*))) as in the definition of orbit complexity. Let us sup- 
pose that we have a minimal length program p^ for the interpretation 



19 



Ii such that Vi < (k) we have d{Ui{pk),T\x)) < 2^^^^^, then there is 
a program for I2 approximating the orbit of x with accuracy 2""^ 
and \p'i^\ < \pk\ + c. The program p'^ runs pk finding strings Si such 
that /i(sj) = Ui{pk), then using the equivalence between Ii and /2 
it finds strings Zi such that d{l2{zi), Ii{si)) < 2^^^^ (Remark ^) by 
these strings it is easy to see how can approximate the orbit of x 
with accuracy 2"^. It follows that £^''{x,2-^) < £^^{x,2-^+^), then 
we have £^^{x) < £^^{x) and exchanging Ii with I2 we obtain the 
opposite inequality. □ 

If X is compact then the orbit complexity does not depend not 
even on the computable structure. 

Theorem 31 If X is compact, if I is a computable interprepretation 
and J is another interpretation function (not necessarily computable) 
then £^{x) > £-\x). 

Proof. Let e > 0, si, G E be a finite set of strings such that 
B^{I{si)), B^{I{sk)) is a cover of X. The set of strings is finite 
because X is compact. It is easy to see that there is an algorithm 
^ : N X S — > {1, k} such that A{i, s) = m implies that the i — th 
point of /(Q(s)) G B^{I{sm))- That is: the algorithm gets a string 
and a natural number and outputs a set B^{I{sm)) of the cover in 
which the i-th point of the interpretation of the string as a sequence 
in X is contained. The algorithm calculates the distance between the 
i — th point of /(Q(s)) G B^(I{sm)) and I{sz) for all z £ {1, k} with 
accuracy |, until it finds an Sm such that d{Ui{s), I{sm)) < f this is 
possible because / is a computable interpretation. 

Now let us consider the interpretation J. Even for the interpreta- 
tion J there is a finite set {s'l, ■■■s'j^,} such that Bt:{J{s[)), B^{J{s'j^,)) 
is a cover of X. Now let us consider a function G : {l,...,k} — > 
{l,...,k'} such that G{i) = j if I{si) G B^{J{s'j)). Being a function 
between finite sets G is a recursive function. 

Now let p be a minimal length program that allows to follow the 
orbit of X for n steps with accuracy e and interpretation /, that is 

max {d{Ui{p),T\x))) < e,\p\ =£^{x,n,e). 

0<i<n 

For each i by calculating A(i, U{p)) we can find an m such that T^{x) G 
B2e{I{sm)) and then by function G we can find a j such that T'^{x) G 

Summarizing, this procedure allows (given the program p) to calcu- 
late a sequence of strings Sj^ , sj^ such that we can follow the orbit of 
X with the interpretation J, for n steps and accuracy 3e. This implies 
that |p| + c > £'^{x, n, 3e) where c is the length of the above procedure 
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and does not depend on n. From this we have £\x, e) > £'^{x, 3e) and 
£'^{x) < £^{x). □ 

From the above theorem we see the curious fact that in the com- 
pact case the orbit complexity reaches its maximum over all interpre- 
tations at a computable interptetation (a sort of Kolmogorov-Sinai 
theorem if we keep in mind the parallelism between orbit complexity 
and entropy) and the orbit complexity with respect to a computable 
structure does not depend on the choice of the computable structure 
( if some computable structure exists on the space). Moreover, all this 
is true independently of the properties of T. 

Corollary 32 If X is compact, if I and J are computable inter- 
pretations (not necessarily from the same computable structure) then 
£\x) =£-\x). 

The orbit complexity is invariant for constructive isomorphisms of 
dynamical systems over non compact spaces, it stated in the following 
propositions. As before we remark that if the space is compact con- 
structivity is not required. We omit the proofs that are similar to the 
previous ones. 

Theorem 33 If {X,d,T), (Y,d',T') are topological dynamical sys- 
tems over metric spaces with computable structures Z, J and f is onto 
and it is a morphism between {X, d,I) and {Y, d\J) such that the fol- 
lowing diagram 

f 

X ^ Y 

T I i r (2) 

X ^ Y 
f 

commutes, if X € X and y = f{x) G Y then £^{x) > £'^{y). 

Theorem 34 // {X,d,T), {Y,d',T') are topological dynamical sys- 
tems over compact metric spaces with computable structures I, J , if 
f is an homeomorphism X ^ Y such that the diagram |^ commutes 
and X G X and y = f{x) G Y then £\x) = £'^{y). 

3.3 Complexity of points 

Now we define a function S^{x,e) : X x R — > R, the function is a 
measure of the complexity of the points of X. The function is non 
increasing and measures how much information is necessary to ap- 
proximate a given point of X with accuracy e. Thus it is a function 
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that does not depend on the dynamics. In |16| a definition of local 
entropy for points of metric spaces was based on this idea and connec- 
tions between S and the concept of dimension are shown. In particular 
S{x, e) is related to the local dimension of X at x. 

Definition 35 If I is an interpretation function, U an universal com- 
puter we define the information contained in the point x with respect 
to the accuracy e as: 

5^(x,e) =min{|p| s.t. d{I{U{p)),x) < e] . (3) 

The function S depends on the interpretation /. In the following we 
will avoid to mention explicitly the superscript / when it is clear from 
the context. The function S depends also on the choice ollA. As stated 
in section 2.3 this function can be extended to a function S* : X x 
R* — > R*. Unfortunately S* may be not compatible with the relation 
~, for this reason we define S' : X x R*/ 7?. as follows: 

S'{x^a) =sup [5*(x,a)]. 

If a S 7^ is an equivalence class then S' {a) is the equivalence class 
of the supremum value of S*{a) where a ranges in the class a. Since 
an equivalence class in i?*/ ~ does not change by the adding of a 
constant, then the function S' does not depends more on the choice of 
the universal computer U in the definition of S. In the same way we 
define 5^ : X x R*/ 7^ as: 

SU^x^a) =inf [S*{x,a)\. 

Finally we extend S' and S!_ to functions S,S_ : X x TZ ^ TZ as 
follows: if a G 7^ and a = p{ai) (the Oj are in R* / ~ ) then we define 

S{x,a) =p{S'{x,ai)), S_{x,a) =p{S^{x,ai)) 

this is well defined because TZ is closed by countable inf and sup and 
it does not depend on the choice of Oi in the class a. Because 5 is 
monotonic and then (oj) « (a-) implies S'{x,ai) ^ S'{x,a'^). 

If I and J are in the same computable structure I then the func- 
tions and 5"^ are equal. does not depend on the choice of the 
interpretation in the computable structure. 

Lemma 36 S and S_ are independent of the choice of I 2, in other 
words I, J ^ I implies s\x, e) = S"^(x, e) and S_\x, e) = S_'^ {x, e). 
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Proof. The proof is very similar to the proof of Lemma ^ and we omit 
it. □ 

We remark that if X = R*^ or X is a finite dimensional manifold then 
S = S. 

Remark 37 If {X,d,I) is a metric space with computable structure 
I and the lower box counting dimension^ of X is finite : dim n(X) = d 
then S{x,S) < —dlog6 + C where C is a constant not depending on x 
and 6. Hence S and S_ coincides for all the points of X. 



The proof follows from the observation that if X is finite dimensional, 
then the minimum number of balls in a cover of X with radius e is 
such that He ~ e~'^. By the computable structure we can construct the 
centers of a suitable cover with ~ e~'^ and obtain that each point of 
X is approximated with accuracy e by indicating a particular center 
of the cover, which costs < log{n^) + c < — dlog(e) + C bits, where 
c represents the length of the procedure that construct the centers of 
the suitable e— cover. 



Lemma 38 If x £ R", is the Lesbegue measure on R", if e ^ 
then for ^-almost all x G R", S^{x,e) = —nlog{e) + o{log{e)) and if 
a =inf [J{an,e)\ then S_{x,a) = S{x,a) =inf [J{log{an,e))]- 

e e 



Proof. We prove that for almost all x G R" lim _5^/og'(g) — 1- Theorem 



12 of 1 16 1 states that the set 

W'^ = {x£ R" s.t. liminf — ^— '- < d} (4) 



has Hausdorff dimension less or equal than d. This implies that if 
e = 2~'^ then liminf f^i^'f\ =liminf ^ ^^'^ ^-^ . If liminf < 

1 then X because S{x,2-^-^) < 2^"*(-t)) < S{x,2~"'+^f\. 

This implies that the set of the x s.t. liminf ^Jl^g(^^^ < 1 is included in 

the set U that is a measure set. To prove the other inequality 

d<n 

it is enough to remark that each x G R can be approximated with 
accuracy e by specifying its first —int{log{e)) digits, if x G R" we 
need —nlog{e) digits to explicit the n coordinates. □ 



^See e.g. @. 

"^intir) denotes the integer part of r 



23 



3.4 Initial data sensitivity and orbit complex- 
ity 

Now we are ready to state the first proposition linking orbit complexity 
to initial data sensitivity. 

Proposition 39 If {X, T) is a dynamical system on a space with a 
computable structure I, I I and T is constructive. There are con- 
stants c\ and C2 such that For a// x G X, n G N, e G 

£^ {x, n, 2e) < (x, r{x, n, e)) + log{n) + ci (5) 

S^{x, R{x, n, 3e)) < £\n, x, e) + C2. (6) 

Proof o/|^. We will see that there is a program p such that d{Ui{p),T^{x)) < 
2e, Vz < n and \p\ < S{x, r{x, n, e))+log(n)+c. If we have a programme 
such that (i(/(Z^(po)),x) < r{x,k,e) thenVi < k d{T'{x),T'{I{U{po))) < 
e. 

The idea is that by constructivity if we have the string sq =U (po) 
we can follow the orbit of I{sq) by an algorithm A{so, k, e) (see Lemma 
[l3|) . The program p will codify the following procedure: 

1) run the program pQ and compute sq =U{po) 

2) compute Sj = A{sQ,i, e),yi <i<k 

3) compute the single string s such that Q(s) = (sq, 

The length of this program will be a constant (the above stated 
procedure) plus log(A;) (the length of a binary representation of k) 
plus the length of po . If po was supposed to be the shortest program 
such that d{I {U (po)) , x) < r{x,k,e) then its length is the value of 
S{x,r{x,n,e)) and the first part of the statement is proved. 

Proof o/[^. Let e G N such that 2"*^ < e. If we have a program p 
such that d(T^{x), Ui{po)) < e for < i < A; we can find a string s s.t. 
/(s) G B{x,n,3e) with the following procedure: 

1) By pq compute the number k and the strings sq, Sk such that 
{so,...Sk) = Q{U{po)) 

2) for each c G S do the following things: { compute A{c,i,2~^) 
for each < i < /c , if for all < i < A; D{A{c, i, 2"^), Sj, e + 2) < 2''' 
then s = c and stop the procedure. } 

The procedure must stop because of the density of the image of 
/. At some time the step 2) will be computed with a c such that 
/(c) G B{x, n, 2~^~^) and this string will verify 2). On the other hand 
if we find a c that stops the procedure then it is easy to see that 
/(c) G B{x, n, 3e). This will implies that d{x, /(c)) < R{x, k, 3e). Sum- 
marizing we have described a procedure that starting from a program 
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Po outputs a string s such that d{I{s),x) < R{x,k,3e). The code for 
this procedure will be a program containing pQ and its length will 
be Po + C* where C represents the length of the code for the above 
procedure which does not depend on x and k, and the statement is 
proved. □ 

From the previous statement we obtain a relation between the 
indicators of orbit complexity and sensitivity. 

Theorem 40 // {X, T) is a dynamical system on a space with a com- 
putable structure I and T is constructive. For all x ^ X 

£^{x) < max(S^{x, r(x)), [J{log{n))]) (7) 
S^{x,R{x)) <£^{x). (8) 

Proof. If we apply the homomorphism J to equation ^ we obtain 

J{£^{x,n,2e)) < J{S^ {x,r{x,n,e))) + J{log{n)) 

, then J{£^ {x,n,2e)) < J(r(x, n, e))) + J{log{n)), and consid- 

ering the equivalence classes: 

£^{x,2e) < max{S'\x,r^{x)),[J{log{n))]). 

This is true for each e, then £^{x) < max{s\x,r{x)) + [J{log{n))]). 
As proved before all this equivalence classes does not depend on the 
choice of / € X and we have Equation |^. In the same way we can 
obtain equation ^.n 

By Lemma ^ for almost all points in R" the function S is the 
logarithm, this, combined with proposition ^ implies the following 
formulas: 

Theorem 41 If T : R" R" is constructive on R*^ with the stan- 
dard computable structure, for almost all x ^ X 

£^{x) < max{ inf {[J{log[r{x, n, e))]), [J{log{n))]) (9) 

eeR+ 

inf [J{log{R{x,n,e)))]<£{x) (10) 

eeR+ 

As a corollary of Theorem ^ we can obtain the following interest- 
ing result: the set where the sensitivity to initial conditions is more 
than exponential in all directions has Hausdorff dimension. 
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Theorem 42 If (X, T) is a dynamical system on a compact metric 
space with a computable structure I and T is constructive. Then the 
set 

exp = {x£X s.t.yh £ R+ R{x) < [7(2"^")]} 
has zero Hausdorff dimension. 

Proof. Let us consider a point x such that R{x) < [J{2~^"')] 
by theorem 40 we know that S^{x,R{x)) < £-^{x) since X is com- 
pact we have £^{x) < [J(n)]. Then S^{x,R{x)) < [J(n)]. Since S 
IS a non mcreasme; function then [7(2"^")]) < S^{x,R{x)) < 

[J{n)]. Then by definition [7(2"^")]) = inf [S*{x,a)] > 

ae[J{2-''")] 

J(2-(^-^)"))] for some small e and then [S'*(x, 7(2-^^^^)"))] < 
[J(n)], by this, setting h' = h — e \i follows that there is a bounded 
constant ci / such that S*{x, 7(2"'^'")) < ci J(n). 

Let us consider the following set = {x £ X| J( '^^^'^ — ^) < d} , 
since for each sequence 6j we have J{bi) > liminf(6j) then A'^ C VF'^ 
where is the set defined in eq. ^. Since the Hausdorfi' dimension 
of is greater or equal than d then also dim/f(A'^) < d . Now let us 
consider the set 

A''^^' = {x£X\J{^^^^^^^—l)<d} 



If X G A'^'^' , let us set k = h'i and let us consider — if 

77 

j, S(x,2-^'^) . ^ ^ ^^^^ ^.^.^^ i ^H''^^ ) < J{^^~^) < d because 

fe^oo 77 

S(x Six 2"^^) / I — 7\\ — 

^ ' ^ is a subsequence of — - (Axiom |1^) . Then x £ W h' . 

17 

d 

This implies that if x G exn then x £^ Wi^ which has Hausdorff 

h' 



dimension (again by |16] Theorem 12). □ 



4 Applications to the Mannevile maps. 

In this section, in order to give a non trivial example of application 
of the theory exposed in the previous sections we present some exam- 
ple of weakly chaotic dynamics. We construct a class of examples of 
dynamical systems over the unit interval with stretched exponential 
sensitivity to initial conditions and information content of the orbits 
that increases as a power law. We precise that the maps we are 
going to study are not weakly chaotic in the sense of (zero topo- 
logical entropy), conversely they have positive topological entropy. In 
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this examples however for almost all the points (for the Lesbegue 
measure) the dynamics are weakly chaotic (low orbit complexity, low 
initial data sensitivity). Then we can say that the system is weakly 
chaotic with respect to the Lesbegue measure. 

The examples are piecewise linear version of the Manneville map 
T : [0, 1] [0, 1] defined as Tz(x) = x + {mod 1), z G (l,oo). The 
so called Manneville map comes from the theory of turbulence. It was 



introduced in |22| as an extremely simplified model of intermittent 
behavior in fluid dynamics, then the map was studied and applied in 
other areas of the physics (for example Q , |^] , [^] ) . 

The first study of the mathematical features of the Manneville 
map was done by Gaspard and Wang in |19]. However in our opinion 



In their paper some steps of the proofs were difficult to understand 
and some others were not rigorously formalized. In the following we 
outline the construction done in [^] for the study of the complexity 
of the piecewise linear Manneville maps by the theory of recurrent 



events [14|. Then we prove the main features of this important class 
of dynamical systems by the theory exposed in the previous sections. 
Another study of the Manneville map was done by C. Bonanno in 
where the dynamics was studied also from a topological point of view. 
Notations: if {ai),{bj) : N — > R are real sequences, in the following 
we will write {ai)^{bj) if and only if |^ is bounded, we also write 
(aj)~(6j) if and only if lim ^ = I. 

Let e = (ek) ■ N ^ [0, 1] be a monotone sequence, such that 
lim efc= 0. Let : [0, 1]— > [0, 1] be defined by: 

fc— >oo 



Teix) 



gfc-2~gfc-l I 

1-eo 



x-efc) + efc_i k > 0,€k < X < ek^i 
eo<x<l 



To each sequence is then associated a piecewise linear map (see 
fig. 1) and a dynamical system ([0, l],Te). 

In order to apply the theory of recurrent events, we associate to 
our dynamical system ([0,1], T^) a stochastic process Xj.The process 
is defined on the probability space (^i,/i), where $7 = [0,1] and /u is 
the Lesbegue measure as follows. Let us consider the sets Ai,i S N: 
Ao = (eo,l],..., Ai = {€i,ei-i]. Let / : R ^ N be given by /(x) = 
n <^ X £ An {f associates to each point x the index of the set Ai 
in which x is included). The associated stochastic process is given by 
the random variables : $7 ^ R , given by Xi{uj) = f{Tl{uj)). As it 
was remarked in [^] the process Xi is a Markov chain with transition 
matrix 
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Figure 1: The map and the partition Ai 
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where pi = fi{Ai) = fi{Xk = i\Xk-i 



0). Summarizing: we constructed a family of dynamical systems (one 
for each infinitesimal sequence). To each one of them it is associated 
a Markov chain. The statistic behavior of the Markov chain can be 
studied by the theory of recurrent events |jl^ and will give infor- 
mation on the dynamics. The family ([0,1], T^) is a large family of 
dynamical systems with different chaotic behavior. In the following 
we will study the systems in which ~ Such dynamical systems 
give rise to stretched exponential initial data sensitivity and power 
law orbit complexity. However if decreases slower than a power law 
(ej ~ 6.g.) we will have a variety of other possible behaviors of 
orbit complexity and initial data sensitivity that will be not studied 
here. 

Now we consider a subset of the above family of systems, which we 
consider as P.L. versions of the Manneville map. Let z G (2,oo), let 
us consider the map associated by the above construction to the 
sequence 



1 



The map Tz is then associated to a Markov chain with transition 
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probabilities po = 1 — cq, pi = ^ Vi > 1. 

(i+i)^ 

The theory of recurrent events can now give us information on the 
dynamics of the Markov chain. Let us consider the random variable 
Nn{x) that is, the number of times that the event Aq occurs until the 
time n: iV„(x) = #{i\Xi{x) = 0} = #{i\T'{x) e ^o}- Theorem 10 of 
10 applied to our Markov chain says that if l — J2i>kPi ~ Ak'"' then 
E(Nn) ~ Cn°. Since for the Markov chain associated to we have 

1- E Pi ~ i^^"^ then E{Nn) ~ Cn^ . 

i>k ^ 

Since the function is not continuous at eg our theory is not 
directly applicable to the dynamical system ([0, 1],T2). The following 
lemma and its proof shows how to extend our theory to discontin- 
uous dynamical systems. A real number is constructive if it can be 
approximated at any accuracy by an algorithm. 

Definition 43 A number z G Ti is said to be constructive if there is 

an algorithm Az{n) : N ^ Q such that Az{n) = q implies \q — z\ < 
2~n_ 

The rational numbers, the algebraic numbers are constructive, and so 
are all the numbers that can be explicitly used for numerical purposes, 
for example vr and e are constructive. 

Lemma 44 If z is constructive. For the dynamical system ([0, l],Tz), 
for all X G [0, 1] equation |^ and |^ holds. 

proof. Let us consider the set X = [0,1] — {x|3A; G N,T^{x) = eo}- 
Let us consider an interpretation function /' on X as follows: if / is 
defined as in equation || then I' : T, X is given by/'(s) = /(s)-|-7r. 
/' is a computable interpretation because vr is constructive and its 
image is in X because vr is transcendent. If z is constructive then it is 
easy to see that is constructive on (X, d, X) where I' Gl then we 
can apply Proposition ^ to {X,Tz,I). On the other hand, since the 
inclusion i : X ^ [0, 1] is isometric the complexity of an orbit in X 
is equal to the complexity of the corresponding orbit in [0, 1]: Vx G X 
£^'{{[0,l],Tz),x,n,e) = T,), x, n, e). If conversely x G [0,1]-X 

then £^ (([0, 1], T^), x) = [J{log{n))] because the orbit of x converges 
to a fixed point. Then eq. ^ and |6| holds for all points of [0, 1] for the 
interpretation /'. Now, since [0, 1] is compact (see theorem ^) we have 
that the orbit complexity does not depend on /' and the statement is 
proved. □ 

Now let us give an estimation of the initial data sensitivity of the 
map Tj by the behaviour of A''^. Let x,y G [0,1], d{x,y) = Ax(0) = 
eo- Since the derivative of Tj exists for almost all points and it is 
greater than 1, if eo is small enough (e.g. is such that eo < ^) then 
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d(Tz{x),Tz{y)) > eo- If eo is small enough (e.g. eo is such that Vi < 
n,d{Ti{x),Ti{y)) < f ) , then d{T^{x),T^{y)) = Ax{n) > eo2^^- 
where c is a constant that depends on the derivative of in Aq and 

If d{x,y) = eo = e2-^^" then Ax(n) > eo2'=^"(^) > e. This implies 
that y i B{n,x,e) = {y e X : d{T'{y),T'{x)) < e V < i < n} (as 
defined in section 3.1) and symmetrically y' = 2x — y ^ B{n,x,€), 
then eo = e2-'=^"(^) > R{n,e,x) (and then R{x) < [J(2-'=^"(^))]). 

By this we can give an estimation of the complexity of the orbits of 
the Manneville maps. In analogy with the results of p!9| ] we are ready 
to state the following proposition about the asymptotic behavior of 
the average orbit complexity in the Manneville map. 

Proposition 45 // z is constructive. The average asymptotic behav- 
ior of the complexity of the orbits of is for each e 

E{£^{x,n,e))^n'' 

where a = 

Proof. Since we have R{n,e,x) < ^2~'^^"-^^^ by proposition ^ and 
proposition ^ —log{R{x, n, 3e)) + o{log{R{x, n, 3e))) < £^ {x, n, e) +ci 
for almost all X G [0, 1], then £'^(x, n, e) > cNn{x)+o{Nn{x)) + const + 
log{e) and E{£^{x,n,e)) > cE{Nn{x)) + E{o{Nn{x))) + const + log{e). 
But since E{Nn{x)) ~ n" by the theory of recurrent events, we have 
that for all e, n" = 0{E{£^ {x,n,e))) (that implies [J{E{£^ {x,n,x,e)))] > 
[J(n")] with our notations). 

Now let us give an estimation from above of the average orbit 
complexity in the Manneville maps. As before we see that the number 
Nn{x) will give the main part of the complexity of the orbit of x. 

Let us consider an interpretation I for the standard computable 

structure in [0, 1] and a minimal cover B^{I{so)), B^{I{si)) of [0, 1] 

(i.e. a cover of [0, 1] such that each its proper subset does not cover 

[0, 1]). The number / of balls in this cover is then bounded by / < i. 

Now let us consider the sets Ai defined above. We remark that if 

1 — J2i>k < ^ then Ak C B^{I{sq)). Now we remark that the 

- (i+i)^ 

symbolic dynamics of the point x with respect to {^j}jgN i-e. the 
sequence of Ai^, ...,Ai^ such that T'!^{x) G Ai^ it is determined by the 
recurrence times of the set ^o- The sequence (Aj,J = Aip, Ai^ must 
be such that if z„ > then Ai^^-^ = Ai^^i and if i„ = then 
can be any one of the Ai (see fig 1). For example a possible sequence 
is ^0) ^1) ^0) ^3) ^2; ^1; ^0) ^0) ^2; ••• such a string is determined by 
the sequence P of numbers representing the recurrence times of ^Oj 
i.e. for the above example P = (0,1,3,0,2,...). We remark that the 
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string Pn{x) = (ti, i7v„(a;)) representing the recurrence times of Aq 
for n steps of the orbit of x contains Nn{x) numbers. Then the binary 
length of Pn{x) is about X^i^"! log{ti). 

An algorithm A^(n, m) to follow the orbit of x with accuracy e (i.e. 
such that if n < m and A^{n,m) = b then T^{x) G ^^(/(sf,)) ) can 
be constructed in the following way. The algorithm contains a string 
Pmix) of the recurrence times with respect to Aq, with this string we 
can reconstruct the symbolic orbit of x with respect to {ylj}jgN for 
m steps, as described above. Moreover the program contains another 
string Qmix) containing at most (/ — l)A^„,(x) numbers, each one is 
less or equal than /. The meaning of Qmix) will be explained below. 

The algorithm starts with a pointer to the first number of Qm{x). 
By Pm it calculates the set Ai^ such that TJ}{x) £ Ai^^, if i„ is 
such that 1 — y^.^i ^ z < e then A^(n,m) = because then 

T^{x) £ B^{so)- Else the algorithm outputs the number of Qm{x) in- 
dicated by the pointer and then set the pointer on the next number. 
In other words, when T^{x) may not be in ^^(•so) then the algorithm 
gets the number q such that T^{x) G B^{sq) from the list Qmix)- 
This can not be too expensive because the point can be out of B^iso) 
at most (/ — l)Nnix) times. The total length of the program imple- 
menting A^in,m) for m steps of the orbit is then less or equal than 
J2f=i logiU) + (/ — l)Nnix)logil) + C where C is constant with respect 
to m, I depends on e but not on m. 

The term Y.^^i logiU) can be estimated as follows: we remark that 
while the random variables ti are independent and identically dis- 
tributed they have no finite expectation when pj~^,l<a<2 
iEiti) = YlWi) instead the random variable log{ti) has finite expec- 
tation, let us say E{log{ti)) = t. Then Y.f=i logiU) = iVn(^"^^^^), 
by the law of large numbers we have that for each 6 > 1, for almost 

each X, eventually with respect to i we have ^'^j^'"^^*'^ < Si. 

This implies that for almost each x, eventually with respect to n 
£^ix,n,e) < cNnix)5i+const andthen Ei£^ ix,n,x,e)) > CEiNnix))+ 
const. But since EiN^ix)) ~ we have that for all e, Ei£\x, n, e)) = 
0(n"). □ 

The above Theorem is an estimation of the average orbit com- 
plexity of the map T^, to show how our theory can be applied to 
prove rigorously the statements of however stronger results can 
be proved. By [19| page 4592 eq. 2.9 (which follows from [14| theorem 
7, page 106) we have that there exists a constant A such that 

where a = and Ga is the Levi stable distribution law with param- 
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eter a. It follows that Nn{x)^Cn°' for almost all points in the interval. 
Prom this, by the same proof as above it follows the pointwise estima- 
tion: 

Theorem 46 With the same notations as above, For almost all x G 
[0,1], f(x,n,e))^n". 

Similar results are obtained by |^] using different techniques. 

5 Numerical experiments 

We want to remark that while the information content of an orbit (as 
it is defined in this work) is not computable (the algorithmic infor- 
mation content of a string is not a computable function) there is the 
possibility to have an empirical estimation of the quantity of informa- 
tion by the use of data compression algorithms. If instead to measure 
the information contained in a string by its algorithmic information 
content we consider as 'approximate' measure of the information con- 
tent of the string the length of the string after it is compressed by 
a suitable coding procedure we obtain a computable notion of orbit 
complexity. In the positive entropy case the computable orbit com- 
plexity is a.e. equivalent to the previous one Such a definition 
of computable orbit complexity allows numerical investigations about 
the complexity of unknown systems. Unknown systems underlying for 
example some given time series or experimental datas. 

The existence of a computable version of the orbit complexity 
motivates from the applicative point of view the study of the orbit 
complexity itself and its relations between the other measures of the 
chaotic behavior of a system. 

In Q and such numerical investigations are performed by di- 
rectly measuring the complexity of the orbits of the Manneville map 
and of the logistic map at the chaos threshold. The results agree with 
theoretical predictions and some interesting conjecture arises. 
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